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2 Field of the Invention 

3 The invention relates to data communications and, more particularly, to improvements in 

4 traffic shaping apparatus for packet-based data communications networks. 

5 Background Description 

6 Modern high speed packet-based data communications networks, such as those employing 

7 Asynchronous Transfer Mode (ATM) technology, allow bandwidth to be reserved in advance. This 
gn is useful, in particular, for the transport of real time data such as voice or video. In ATM networks 
9%j the requesting user must call the network control entity to set up a logical connection. Parameters 

/oE are given in the call set up request which specify the required bandwidth. If all the requested 

11& parameters can be granted by the network controller the call is set up, otherwise it is refused. 

An important problem in such networks is to ensure that traffic flowing in a particular 

/3H network connection respects the bandwidth limits which were negotiated for that call at set up time. 

14f S This is to guarantee that each connection only uses its share of the network resources, thereby 

15ft minimizing the probability of lost data or other problems resulting from congestion in the network. 



16 Data loss within the network must be avoided not only because missing information can alter 

17 the nature of the traffic -for example a missing cell can generate a glitch on a voice connection - but 

18 also because data loss can provoke data retransmission by higher level communications protocols 

19 thereby increasing the traffic on the connection and worsening network congestion - leading to a 

20 higher probability of further data loss, 

21 To ensure that traffic within a connection conforms to its negotiated bandwidth parameters, 

22 traffic shaping or scheduling techniques have been developed for use at various points within the 



/ network in order to modify the flow of data within a connection to conform to its agreed parameters. 

2 Various policing schemes are also used in order to control and, if necessary, penalize traffic in the 

3 network by discarding cells from connections which try to exceed their allotted resources. 

4 A wide variety of traffic shaping and policing methods have been proposed and studied. 

5 Many of these require a complex computation of an optimized cell transmission schedule. An 

6 example of such a technique can be found in EP-A-702472. This optimized transmission schedule 

7 must be recalculated if connections are added or deleted. Consequently, these methods are not easy 

8 to implement for use at the very high speeds required by modern networks. 

9 Summary of the Invention 

/oM It is an object of the present invention to provide a simple traffic shaping and/or policing 

11 rfi technique which can be implemented in hardware at reduced cost. 

1 r< 

12 "0 In brief; this object is achieved by {Jffic shaping apparatus for packet data communications. 

; 3 u : The apparatus comprises one or more packet queues for traffic having a plurality of different desired 

14lZ packet transfer rates, one queue being assigned to each desired packet transfer rates. Cell receiving 

/jE ri logic is provided to receive incoming packets and to place each incoming data packet in a queue 

/tfO which handles the packet transfer rate for the traffic to which the packet belongs. A plurality of 

17 timing circuits are provided, each of which is arranged to operate at a different frequency. The 

18 frequencies are selected so that the desired packet transfer rates can be approximated by combining 

19 subsets of the available frequencies. The combined outputs of timing circuits in each subset provide 

20 packet transfers signals for a particular queue. Cell transmission logic responds to the packet 

21 transfer signals to transfer a packet from the corresponding queue to an output. 

22 The invention is particularly, but not exclusively, applicable to ATM networks which employ 

23 short fixed length cells and in which traffic is carried over a number of connections each having an 

24 associated nominal packet transfer rate. In this environment, the system may have one queue for 
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/ each connection or, alternatively, one queue corresponding to a group of connections having an 

2 associated maximum aggregate packet transfer rate. Incoming packets are received and placed in 

3 the queue corresponding to the connection or group of connections to which the packet belongs. 

4 Brief Description of the Drawings 

5 The foregoing and other objects, aspects and advantages of the invention may be better 

6 understood from the following detailed description of a preferred embodiment of the invention with 

7 reference to the drawings, in which: 

8 Figure 1 is a schematic diagram showing traffic shaping apparatus; 

9 m Figure 2 shows the timing unit of the apparatus of Figure 1 ; 

10 G Figure 3 is a flow diagram illustrating the operation of the timing unit; 

// f Figures 4A, 4B and 4C are timing diagrams illustrating the operation of the timing unit; and 

12 5 Figure 5 shows a switching hub including the traffic shaping apparatus of Figure 1 . 

13 Detailed Description of Preferred Embodiment of the Invention 

14 Figure 1 shows in schematic form a traffic shaping device 100 for packet data 
/ 5 communications. The apparatus includes a set of cell queues, such as queue 1 10, which are defined 

16 in known fashion using appropriate pointers in a cell buffer memory (not shown). Each queue 

17 corresponds either to a particular reserved bandwidth ATM connection having a particular maximum 

18 cell transfer rate which was negotiated when the connection was established or to a group of 

19 connections for which there is a maximum permitted aggregate bandwidth. Enqueuing logic 120 

20 is provided to receive incoming cells from input 1 25 and place the incoming data cells in the queue 

FR 9 95 041 -3- 



/ 



assigned to the connection to which the data cells belong. 



2 Each queue 1 10 has a threshold 1 12 which is set according to the maximum Cell Delay 

3 Variation (CDV) allowed for the connection. If the queue is filled to the threshold, any further 

4 packets arriving for that queue are discarded by sending them to a free queue 1 15 which holds all 

5 the cells not currently in use by the system. This provides a simple policing function to ensure that 

6 the negotiated traffic parameters, in particular the CDV, is not exceeded. 

7 A timing unit 130 is provided which includes a plurality of timing circuits 140. For ease of 

8 understanding, timing circuits 140 are shown in schematic form only in Figure 1 and will be 
9 „ described in more detail below. As will be understood from the description which follows, timing 

10 a circuits 1 40 need not be physically separate within timing unit 1 30, but may be implemented using 

/ / Q a common counter and control logic. 

12^ Timing circuits 140 are each arranged to operate at a different one of a series of frequencies, 

/5= F/2 n with n= 1, 2, 3 .... n max , where F is the maximum packet transfer rate. The effective packet 

I4ll.. transfer rate for each connection is established by combining outputs from the different timing 

752 circuits; that is by creating subsets of packet transfer signals at the different frequencies providing 

/<© by the timing circuits. Figure 1 shows timing circuits capable of generating packet transfer signals 
at frequencies F/2, F/4, F/8, F/16, and F/32. Using timing circuits such as those illustrated, any 

18 frequency can be approximated to an accuracy of F/32. For example, if a desired cell transfer rate 

19 for a particular connection is 15F/32, this can be represented by F/4 + F/8 + F/16 + F/32. In a 

20 preferred embodiment, F is 1 .5 Mcells/sec which corresponds to a throughput of 636 Mbits/ sec for 

21 standard fifty-three byte ATM cells.. 

22 The timing circuits whose outputs are combined to generate a desired packet transfer rate for 

23 a particular queue are arranged as described below to generate packet transfer signals on line 145 

24 for that queue. As an example, if one of queues 1 10 is assigned to aconnection having a negotiated 

2 5 maximum packet transfer rate of 1 5F/32, then outputs of timing circuits capable of generating packet 



transfer signals at the respective rates of F/4, F/8, F/ 16 and F/32 would be combined to established 
an effective total packet transfer rate of 15F/32 for the connection. 

Dequeuing logic 150 is responsive to the packet transfer signals to transfer a packet from its 
queue to output 155. 

Figure 2 provides more detail about a timing unit 130. The unit 130 comprises a counter 200 
which is incremented at frequency F. The count value generated by counter 200 is decoded by 
decoder 210 to produce activating signals on lines 220 at appropriate times. Each of lines 220 
corresponds to a particular frequency in the series F/2 n with n= 1, 2, 3 .... n max . Only 5 frequencies 
are shown in Figure 2, although in practical implementations more frequencies could be used. In 
a preferred embodiment, a total of 15 different packet transfer frequencies would be generated, 
which means that any desired packet transfer output can be approximated with a precision of F/2 15 . 
The activating signals are produced at the start of each period for the particular frequency. 

There is a phase difference of half a period between the activating signals for neighboring 
frequencies in the series, so that, for instance, the activating signal for frequency F/4 occurs in the 
middle of the period for frequency F/2. This spreads the packet transfer signals for each connection 
over time and thereby reduces the burstiness of the output traffic for each connection. 

Lines 220 are connected to set/reset circuits 230. There is one set/reset circuit 230 for each 
frequency in the series. The set/reset circuit for each frequency is set at the beginning of the 
corresponding period by the signals from decoder 210 on lines 220. 

Timing unit 130 also includes a memory 250 and a control unit 240, which is linked to each 
of set/reset circuits 230 via lines 241 and 242. 

Each frequency of the series has an associated list of queue IDs, represented at 25 1 in Figure 
2, stored in memory 250. Also stored in memory 250 is a list 252 of pointers to a current position 
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1 in each of lists 25 1 . The list of pointers 252 could equally be stored in a suitable register outside 

2 memory 250. 

3 A simple mechanism, which for clarity is not shown in Figure 2, can be used to prevent 

4 setting of any set/reset circuit associated with a frequency not currently needed. In a preferred 

5 embodiment, this mechanism includes a register which is arranged to keep a record of which 

6 frequencies are not currently needed; i.e., which have no queues in their associated list 25 1 . Lines 

7 220 are gated to set/reset circuits 230 under the control of this register. If packet transfer signals at 

8 a particular frequency are not needed, as indicated by the absence of a queue identifier in the list 25 1 

9 associated with the particular frequency, then decoder 2 1 0 is not allowed to set the corresponding 
10 set/reset circuit 230. 

// M Control unit 240 is arranged to poll, over lines 242, the state of set/reset circuits 230 at 

12 m frequency F and generate on line 145 a signal identifying a particular cell queue using the lists stored 

13 )= in memory 250. A new cell queue is thus identified at frequency F and consequently the rate at 
l4 €l which cells are passed to output 155 from queues 1 10 is equal to frequency F. 

15 S Z This process is illustrated in Figure 3 in the form of a simple flow diagram. Set/reset circuits 

16^! 230 are polled in order of decreasing frequency to find the highest frequency for which the respective 

17Q set/reset circuit is set. This is represented by step 300. For the first set/reset circuit which is set, 

18 control unit 240 identifies the current queue ID from a list of queues associated with that frequency 

19 and outputs the queue ID on line 1 45 . This is represented by step 310. 

20 If the queue ID is not last in the list, the pointer is incremented to point to the next queue ID 

21 in the list and control returns to step 300. If the queue ID is the last in the list, control unit 240 

22 deactivates the set/reset circuit corresponding to that frequency by asserting a reset signal on the 

23 appropriate one of lines 241 . This is represented by step 320. The pointer to the list 25 1 for that 

24 frequency in the list of pointers 252 is set to point to the first connection ID in the list and control 

25 returns to step 300. 



I 

2 



Set/Reset circuits 230 are "set" dominant so that if a set signal from decoder 210 occurs at 
the same time as a reset signal from control unit 240, the set/reset circuit remains in the set state. 



3 The fact that the set/reset circuits are polled in order of decreasing frequency provides a 

4 priority control mechanism which ensures that the timing circuits can only generate a packet transfer 

5 signal if there is no timing circuit of higher frequency wishing to generate a packet transfer signal 

6 at that time. In this way, connections having high data transfer rates are given higher priority since 

7 the impact of a given cell delay is a direct function of data transfer rates. 

8 Figures 4A, 4B and 4C represent signals generated in applying this process. Dotted vertical 

9 lines, such as line 405, indicate the beginning of each time period for each of the different 

10 O frequencies, illustrating the phase difference introduced between neighboring frequencies in the 

11 H series. These dotted lines correspond to the signals produced by decoder 2 1 0 on the lines 220. 

12 S In Figure 4A, connection identifiers asserted on line 145 at given times are shown in the 

13 €i OUT line at the top of the Figure. The other solid lines of Figure 4A show the state of the set/reset 

14 U circuits 230 corresponding to the frequencies listed on the left hand side of Figure 4A. 

15 01 In Figure 4A, the scheduling of three different connections is illustrated. The connections 
16Q are identified by the connection identifiers 1, 2 and 3 respectively, in the OUT line. Connection 1 
/ 7 requires a packet transfer rate of F/2. Connection 2 requires a packet transfer rate of 9F/32 or F/4 

18 + F/32. Connection 3 requires a packet transfer rate of 3F/32 or F/l 6 + F/32. Consequently, the 

19 contents of lists 25 1 would, in this example, be as follows: the list for frequency F/2 would contain 

20 connection ID 1 ; the list for frequency F/4 would contain connection ID 2; the list for frequency F/8 

21 would be empty; the list for frequency F/16 would contain connection ID 3; and the list for 

22 frequency F/32 would contain connection IDs 2 and 3. 

23 Once the list of connection IDs for a particular one of the frequencies has been exhausted, 

24 the corresponding set/reset circuit 220 is reset via a signal on the appropriate one of lines 24 1 . This 

FR 9 95 041 -7- 



/ is illustrated by the downward edges, such as downward edge 410 in Figures 4A-C. It can be seen 

2 in Figure 4A that the set/reset circuit for frequency F/32 remains active for several cycles until the 

3 ID for both connections 2 and 3 have been asserted. Only then is the set/reset circuit for frequency 

4 F/32 deactivated. 

5 In Figure 4A it can be observed that, for instance, connection 2 is asserted both when 

6 frequency F/4 is the highest active frequency, as illustrated at 4 1 5, and also when F/32 is the highest 

7 frequency active, as illustrated at 420. This is due to the presence of connection id 2 in the lists 25 1 

8 corresponding to both these frequencies. 

9 In Figure 4B, connection 1 has been eliminated ' and a new connection 4 added with a 
10 ^ required packet transfer rate of 12F/32 or F/4 + F/8. Consequently, the contents of lists 251 are 
11 1;} modified as follows: the list for frequency F/2 is empty, connection 1 having been removed; the list 

12 S for frequency F/4 contains connection ID 2 and connection ID 4; the list for frequency F/8 contains 

13 m connection ID 4; the list for frequency F/16 still contains connection ID 3; and the list for frequency 
14 ^ F/32 still contains connection IDs 2 and 3. 

/j£3 As before, the connection identifier asserted on line 145 at any particular time is shown in 

16^1 the OUT line of Figure 4B. The other lines of Figure 4B show the state of the set/reset circuits 230 

uO corresponding to the frequencies listed on the left hand side of Figure 4B. 

IS In Figure 4C, connection 2 has been eliminated and new connections 5, 6 and 7 added. 

19 Connections 5 and 7 each have a packet transfer rate of 3F/32 or F/16 + F/32. Connection 6 has a 

20 desired packet transfer rate of F/32. Consequently, the contents of lists 25 1 are modified as follows: 

2 1 the list for frequency F/2 is still empty; the list for frequency F/4 contains only connection ID 4; the 

22 list for frequency F/8 still contains connection ID 4; the list for frequency F/16 contains connection 

23 IDs 3, 5 and 7; and the list for frequency F/32 contains connection IDs 3, 5, 6 and 7. 

24 As before, the connection identifier asserted on line 145 at any particular time is shown in 
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1 the OUT line of Figure 4C. The other lines of Figure 4C show the state of the set/reset circuits 230 

2 corresponding to the frequencies listed on the left hand side of Figure 4C. 

3 New connections or groups of connections corresponding to queues 1 10 can be easily added 

4 or deleted merely by creating or deleting a corresponding queue 1 10 and changing the lists 25 1 so 

5 that a packet transfer signal is produced on line 145 at a corresponding rate. 

6 Figure 5 is a schematic diagram showing an ATM switching hub in which such a traffic 

7 shaping device is used. The hub comprises a switching fabric 500 and a number of adapters 5 10 of 

8 which only one is shown in Figure 5. Each adapter 5 10 is divided into two parts, a receive part 5 10A 

9 and a transmit part 5 1 OB . ATM cells are received on inputs 520, multiplexed within the receive part 
1<P 5 1 OA of an adapter and transmitted via switching fabric 500 to the transmit part 5 10B of one of the 
1 /Q adapters, where they are demultiplexed and output on one of output lines 530. 

ifi The shaping device 100 is located in the receive part 51 OA of each adapter and is arranged 

73fi to shape and police the traffic being passed through switching fabric 500. In the parlance of ATM 

7i_, technology, shaping device 100 in the receive part 5 10A has the function of UPC (Usage Parameter 
Control) or NPC (Network Parameter Control), 

/|i A similar shaping device, denoted 100' in Figure 5, can also be located in the transmit part 

/ 7 of the adapter for the purposes of output shaping. In this case, each queue would normally represent 

18 a number of connections which are destined for transmission over a single ATM connection at, for 

19 example, a LAN/WAN interface. For output shaping, the policing function of the shaping device, 

20 ie the thresholds 1 12, is generally not required because such function is normally implemented at 

21 the input of a node. 

22 While the invention has been described in terms of preferred embodiments, those skilled in 

23 the art will recognize that the invention can be practiced with modifications within the spirit and 

24 scope of the appended claims. 
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CLAIMS 

Having thus described our invention, what we claim as new and desire to secure 
by Letters Patent is as follows: 

1 . A method for traffic shaping for packet data communications comprising: 

establishing one or more packet queues, each queue carrying packet traffic 
for a particular connection having a desired packet transfer rate; 

directing each incoming packet to the queue assigned to the connection 
over which the packet is received; 

providing a frequency for packet transfer in a series of frequencies; 
generating packet transfer rates appropriate for each existing output con- 
nection by combining packet transfer frequencies; and 
transferring a packet from an assigned queue in response to combined transfer frequen- 
cies. 

2. The method of claim 1 wherein said directing step further comprises: receiving 
said packets by receiving logic. 

3 . The method of claim 1 wherein said providing a frequency step further comprises: 
generating packet transfer signals by a timing logic circuit. 

4. The method of claim 1 wherein said transferring a packet step further comprises: 
transferring by cell transfer logic circuits in response to said combined transfer frequen- 
cies. 

5. The method of claim 1 further comprising: 

diverting a packet from an assigned queue in the event that the assigned queue is filled 
above a threshold by reception of said packet. 



6. The method of claim 1 further comprising: 
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inhibiting generation of a packet transfer signal if any higher frequency output is enabled 
to generate a packet transfer signal. 

7. The method of claim 1 further comprising: 

establishing lists of associations between a timing circuit and packet queues, said timing 
circuit enabled to generate packet transfer signals for any queue on its list. 

8. The method of claim 1 further comprising: 

generating a phase difference between an outputs from timing circuits for neighboring 
frequencies in the series of frequencies. 

9. The method of claim 1 further comprising: 

generating each frequency of said series of frequencies so that the frequencies are repre- 
sented by F/v, where F is a maximum packet transfer rate and v is an integer value. 

1 0. A method for operating a switching hub having a switching fabric, at least one 
input adapter and at least one output adapter, one or more of said input or output adapters 
including a traffic shaping apparatus, comprising: 

providing one or more packet queues, each queue carrying packet traffic 
for a particular connection having a desired packet transfer rate; 

directing each incoming packet to the queue assigned to the connection 
over which the packet is received; 

providing a frequency in a series of frequencies to generate a packet trans- 
fer rate; 

combining said frequency for a plurality of said queues to generate packet 
transfer rates appropriate for each existing connection; and 
transferring a packet from the assigned queue to a given output connection in response to 
combined frequencies appropriate to the given output connection. 

11. A computer readable media having instructions which a computer responds to for 
practice of the methods of claim 1 or claim 10 written thereon. 
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12. Electromagnetic signals propagating over a computer network, a computer re- 
sponding to said electromagnetic signals for practice of the method of claim 1 or claim 
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ABSTRACT OF THE DISCLOSURE 

A method for shaping network traffic in a computer network is described for 
packet data networks. The method includes one or more packet queues for traffic having 
a plurality of different desired packet transfer rates, each queue being assigned to a con- 
nection having a predetermined desired packet transfer rate. Each incoming data packet 
is directed to the appropriate queue. Each of a plurality of timing circuits operate at a dif- 
ferent frequency in a series of frequencies. The frequencies are selected so that the de- 
sired packet transfer rate for a connection can be established by summing outputs from 
more than one of the timing circuits. 
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